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Abstract 

Background: 

In  1980,  smallpox  disease  was  eradicated  from  nature  and  variola  virus,  the 
etiological  agent  of  smallpox,  was  confined  to  two  laboratories,  one  located  in 
Russia  (Moscow)  later  moved  to  VECTOR  (Novosibirsk,  Siberia)  and  one  in  the 
United  States  (CDC  Atlanta).  Vaccinations  among  the  general  public  ceased 
shortly  after  the  successful  eradication  campaign,  resulting  in  an  increasingly 
immunologically  susceptible  population.  Because  of  the  possibility  of  intentional 
reintroduction  of  the  variola  virus  and  the  emergence  of  other  pathogenic 
poxviruses,  there  is  a  great  need  for  the  development  of  medical 
countermeasures  to  treat  poxvirus  disease.  It  is  highly  likely  that  the  U.S.  FDA 
“animal  rule”  will  necessary  for  regulatory  approval  of  these  interventions. 
Therefore,  relevant  animal  models  and  the  associated  supporting  assays  will 
require  development  that  can  stand  up  to  regulatory  scrutiny. 

Methods 

An  optimized  real  time  PCR  assay  for  the  detection  of  orthopoxviruses  has  been 
developed  by  researchers  at  the  United  States  Army  Research  Institute  of 
Infectious  Diseases  (USAMRIID).  To  support  animal  studies  that  will  be  used  to 
support  approval  of  medical  countermeasures  by  the  U.S.  FDA,  the  assay  was 
designed  to  quantitate  poxvirus  genomic  DNA  in  a  nonhuman  primate 
(cynomolgus  macaque)  blood  matrix  as  a  measurement  of  viremia.  This 
manuscript  describes  the  validation  of  the  process,  including  DNA  extraction  from 
whole  blood  anticoagulated  with  EDTA,  for  obtaining  and  quantitating  monkeypox 
genomes  by  evaluating  precision,  accuracy,  the  standard  curve,  specificity, 
robustness  and  stability  of  the  assay  and/or  components  of  the  assay. 

Results 

The  assay  had  a  lower  limit  of  detection  of  50  genome  copies/5  uL  sample,  upper 
limit  of  quantitation  of  5  x  107  GC/5uL  sample  and  a  limit  of  detection  of  2.5 
genome  copies  /5uL  sample.  The  assay  was  specific  for  orthopoxvirus.  Matrix 
effects  were  detected  and  suggest  the  presence  of  PCR  inhibitor(s)  that  was  co¬ 
extracted  with  the  target  DNA. 


Conclusions 

The  assay  has  been  validated  for  the  purpose  of  quantitating  monkeypox  viral 
load  in  blood  from  cynomolgus  macaques.  This  assay  has  and  will  continue  to 
support  submissions  to  the  FDA  for  approval  of  antiviral  therapeutics  for 
smallpox. 


Background 
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The  cynomolgus  macaque/intravenous  monkeypox  virus  model  was 
developed  to  parallel  certain  disease  aspects  of  smallpox  [4-6].  More  specifically, 
the  model  is  thought  to  recapitulate  the  events  following  secondary  viremia  in 
human  smallpox  patients  [5].  The  animals  develop  fever,  viremia,  a  progressive 
and  centrifugal  rash,  and  exhibit  dose-dependent  morbidity  and  mortality. 
Correlates  of  protection,  such  as  viremia,  can  be  used  for  approval  of  new  drugs  under  the 
FDA's  accelerated  approval  mechanism,  such  as  the  influenza  vaccines  Fluad  and 
Flucelvax.  Quantitative  viral  titer  measurements  like  plaque  assay  method(s) 
and  polymerase  chain  reaction  (PCR)  analysis  by  agarose  gel  electrophoresis 
have  given  way  to  sensitive  and  rapid  PCR  methods  using  minor  groove  binding 
(MGB)  probe  technology  to  detect  amplified  viral  nucleic  acids.  The  Diagnostic 
Systems  Division  (DSD),  at  the  United  States  Army  Research  Institute  of 
Infectious  Diseases  (USAMRIID),  used  MGB  chemistry  to  develop  and  optimize 
an  assay  for  the  diagnostic  detection  of  orthopox  species  [7],  This  assay 
specifically  detects  and  quantifies  an  orthopox  specific  target  within  the  viral 
hemagglutinin  (FIA)  gene  sequence  using  the  Roche  LightCycler®  (Indianapolis, 
IN).  We  subsequently  adapted  this  platform  to  assess  disease  progression  and 
for  the  evaluation  of  potential  antiviral  candidates.  For  the  assay  to  be  truly  useful 
in  support  testing  and  evaluation  work  to  support  medical  countermeasure 
development,  it  needed  to  be  validated  to  the  extent  that  it  would  be  acceptable 
by  the  appropriate  regulatory  body  (in  this  case,  the  U.S.  FDA).  . 

The  goal  of  this  validation  process  was  to  demonstrate  the  overall 
reliability  and  robustness  of  a  well  optimized  assay.  The  validation  sought  to 


TR-17-122 

Distribution  Statement  A:  Approved  for  public  release;  distribution  is  unlimited. 


determine  the  performance  characteristics  of  a  real  time  PCR  assay  for  the  pan- 
Orthopox  virus  HA  gene  in  cynomolgus  macaque  blood.  More  specifically,  we 
assessed:  repeatability;  intermediate  precision;  accuracy  of  the  combined 
extraction  and  amplification  method;  upper  and  lower  limits  of  the  standard  curve; 
storage  stability  of  the  HA  standard  (Variola  Bangladesh  HA  gene),  positive 
extraction  control  (PEC),  and  MGB  master  mix;  specificity  of  the  method  using 
other  orthopox  viruses  and  non-orthopox  viruses;  and  robustness  of  the  method 
using  different  lots  of  reagents  and  different  light  cycler  instruments.  This 
validation  was  conducted  in  accordance  with  the  FDA  Good  Laboratory  Practice 
(GLP,  21  CFR  Part  58)[3]. 


Methods 

Because  the  validation  was  conducted  in  compliance  with  21  CFR  part  58, 
a  study  protocol,  standard  operating  procedures  and  other  documentation  were 
developed  and  implemented  before  the  onset  of  the  study.  Deviations  to  any  of 
the  aforementioned  documents  were  documented  and  formally  reported.  The 
data  packet,  including  documentation,  and  final  report  were  reviewed  and 
accepted  by  USAMRIID’s  Quality  Assurance  and  Regulatory  Compliance  Office 
(QARCO).  For  simplicity,  the  nomenclature  for  lot  numbers,  test  and  control 
samples,  study  assays,  and  study  runs  have  been  re-designated. 

Test  articles  and  reference  materials 
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Monkeypox  virus,  strain  Zaire  79,  was  provided  by  Dr.  Joe  Esposito  (CDC) 
and  extracted  DNA  from  Herpes  Simplex  Virus  1  and  2  (HSV-1  and  HSV-2), 
camelpox,  cowpox,  rabbitpox,  and  variola  viruses  were  provided  by  the 
USAMRIID  Virology  and  Diagnostic  Systems  Divisions. 

DNA  extractions 

Test  and  control  samples  were  extracted  using  the  Qiagen  QIAamp  DNA 
Mini  kit  (catalog#  51306)  adapting  the  manufacturer’s  instructions.  Briefly,  pre¬ 
extraction  inactivation  was  performed  by  adding  IOOuL  of  sample  to  a  tube 
containing  IOOuL  of  PBS,  200uL  of  Qiagen  Buffer  AL,  and  20uL  of  proteinase  K. 
The  tubes  were  placed  in  a  56°±  2°C  waterbath  for  60  minutes  to  inactivate  the 
virus  (data  not  shown).  Extraction  proceeded  according  to  manufacturer’s 
directions  and  samples  were  eluted  in  1 0OuL  volume.  Each  extraction  was 
designated  by  a  letter  given  in  alphabetical  order  and  will  be  referred  to  as  such. 

Test  and  Control  Samples 

Orthopox  negative  EDTA  blood  was  collected  from  a  single,  orthopox 
naive  cynomologus  macaque  ( Macca  fascicularis),  aliquoted  and  stored  at  -70°  ± 
10°C  for  use  as  negative  control  (NC)  samples.  The  positive  extraction  control 
(PEC)  was  prepared  by  spiking  the  NC  with  monkeypox  virus  and  stored  at  -70° 

±  10°C. 

Whole  blood,  collected  from  NHPs  from  previous  in  vivo  monkeypox  studies 
were  stored  at  -70°C±10°C,  extracted  and  stored  at  -20°C±10°C,  or  short  term  at  2  - 
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8°C.  Orthopoxvirus  positive  test  samples  (PTS)  were  either  extracted  orthopox 
positive  NHP  blood  (from  study)  or  orthopoxvirus  negative  NHP  blood  (from  study  or 
naive  animal)  spiked  with  either  stock  monkeypox  virus  or  extracted  viral  DNA.  The 
PTS  used  from  study  material  were  post  infection  day  2  (1 .6x1 01  GC/5ul),  day  5 
(5.6x1 03  GC/5ul),  and  day  8  (2.2x1 05  GC/5ul)  and  were  all  from  the  same  animal. 

Standard  Curve 

A  preparation  of  the  HA  insert  from  a  plasmid  containing  the  Variola 
Bangladesh  (VARV-BSH)  HA  gene  was  used  as  the  standard  (HA  Standard)  for 
quantifying  viral  DNA  as  genome  copies  (GC).  The  HA  (J7R)  gene  of  Variola 
virus  strain  Bangladesh  (GenBank  accession  number  L22579)  was  cloned  [7], 
propagated  in  bacterial  cultures,  and  the  plasmids  were  extracted  using  a 
commercial  kit  (Qiagen).  The  insert  was  cut  from  the  plasmid  using  EcoRI 
restriction  enzyme  and  confirmed  by  electrophoresis.  The  band  was  excised, 
purified  from  the  gel,  and  subsequently  quantitated  on  a  spectrophotometer. 

The  DNA  was  diluted  in  log  increments  from  1  xl  06  genome  copies/uL  to  5 
genome  copies/uL  unless  otherwise  stated. 

Pan-Orthopox  Assay 

The  pan-orthopox  PCR  assay  has  been  previously  described  by  [7],  with  the 
exception  of  quantitation  strategy  utilizing  the  aforementioned  standard  curve. 

Each  LightCycler  reaction  was  comprised  of  5.0  pi  of  DNA  sample  and  15  pL  of 
Master  Mix,  containing  0.5  mM  OPSP-F89  (primer  sequence:  5'  -  GAT  GAT 
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GCA  ACT  CTA  TCA  TGT  A  -  3'),  0.5mM  OPSP-R21 9  (primer  sequence:  5'  -  GTA 
TAA  TTA  TCA  AAA  TAC  AAG  ACG  TC  -  3'),  0.1  mM  OPX-P1 43S-MGB  (probe 
sequence:  6’FAM  -  AGT  GCT  TGG  TAT  AAG  GAG  -  MGBNFQ  -  3'),  IX  dNTPs, 
and  IX  Buffer  (Idaho  Technologies),  in  MGB  water.  MGB  Master  Mix  was  stored 
at  -20°C±10°C  prior  to  use.  All  assays  were  performed  on  a  single  LightCycler® 
(Roche)  with  the  exception  of  the  robustness  testing  where  two  separate  units 
were  utilized.  Data  was  captured  on  a  LightCycler  equipped  with  Software 
version  3.5.3;  because  of  the  concise  data  reporting  features  and  expanded  data 
analysis  capabilities  afforded  by  the  v4.0  software,  results  were  analyzed  and 
reported  using  this  version. 

Calculations  and  Statistical  Analyses 

The  LightCycler®  v4.0  software  performed  an  Absolute  Quantification  analysis  by 
plotting  the  CTs  (crossing  threshold  or  crossing  point)  of  Test  Samples  against 
the  concentrations  (GC  values)  and  CTs  of  the  standards.  The  X  axis  of  the 
standard  curve  represented  the  log  of  the  initial  concentration  of  DNA  and  the  Y 
axis  represented  the  CT.  CT  and  GC  values  were  transferred  to  Excel  Microsoft 
(2003)  spreadsheets.  GC  values  were  used  for  the  calculation  of  means, 
standard  deviation  (SD),  coefficient  of  variance  (CV)  and  recovery.  Acceptable 
CV  for  mean  duplicate  values  and  the  range  of  standards,  controls,  and 
efficiency  values  were  established  prior  to  the  validation  so  erroneous  results  due 
to  technician  error  could  be  dropped  (Table  1).  This  acceptance  criterion  was 
used  for  the  mean  duplicate  values  from  each  run  as  well  as  for  the  mean  values 
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for  each  assay  (usually  comprised  of  3  runs).  Per  the  study  protocol,  a  single 
Standard  Curve  value  could  be  dropped  when  it  did  not  meet  the  acceptance 
criteria  and  the  curve  recalculated. 


Table  1:  Acceptance  criteria  for  standards,  controls,  and  test  samples 


Acceptable  Range 

Acceptable 

Standards  & 

(GC/5pl) 

%CV 

Controls 

Low  to  High 

PEC 

1.58  x  103 

1.58  x  104 

<40% 

50  HA  Standard 

1.58  x  101 

1.58  x  102 

<40% 

500  HA  Standard 

1.58  x  102 

1.58  x  103 

<30% 

5000  HA  Standard 

1.58  x  103 

1.58  x  104 

<30% 

50000  HA  Standard 

1.58  x  104 

1.58  x  105 

<30% 

500000  HA  Standard 

1.58  x  105 

1.58  x  106 

<30% 

5000000  HA  Standard 

1.58  x  106 

1.58  x  107 

<30% 

PTS 

NA 

NA 

<30% 

Efficiency 

1.8 

2.2 

<10% 

PEC:  positive  extraction  control 
PTS:  positive  test  sample 


Results 
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Verification  of  Precision 

According  to  FDA  guidance,  “Precision  describes  the  closeness  of 
individual  measures  of  a  an  analyte  when  the  procedure  is  applied  repeatedly  to 
multiple  aliquots  of  a  single  homogenous  volume  of  biological  matrix”[8].  In  our 
study,  repeatability  and  intermediate  precision  were  assessed  by  determining  the 
%CV  for  orthopox  gene  copies  (GC)  for  all  pertinent  sample  types  (standard 
curve:  HA  gene;  Controls:  Positive  and  negative  extraction  controls,  and  Test 
Samples)  for  each  assay.  Based  on  the  assays  intended  use  (comparing 
multiple  log  differences  of  viremia  in  vivo)  a  %CV  of  less  than  30%  was  deemed 
acceptable  for  repeatability/intermediate  precision  comparisons.  Each  assay 
consisted  of  3  LightCycler  runs.  Two  sets  (A  and  B)  of  3  assays  were  completed 
for  a  total  of  9  runs  per  set  (Table  2).  Each  set  of  assays  included  two  analysts. 
Assays  1 , 2,  and  3  (from  set  A  and  B)  were  used  to  determine  repeatability, 
assay  1  and  3  (from  set  A  and  B)  were  used  to  determine  precision  of  samples 
run  on  different  days  by  the  same  analyst,  and  assay  1  and  2  (from  set  A  and  B) 
were  used  to  determine  precision  of  samples  run  on  different  days  by  different 
analyst. 


Table  2:  Precision  testing  for  repeatability  and  intermediate  precision 


Set 

Assay 

Run 

Analyst 

Day 

Repeatability 

Same  analyst 

Different  analyst 

A 

1 

01,  02,  03 

i 

i 

X 

X 

X 

A 

2 

04,  05,  06 

2 

2 

X 

X 

A 

3 

07,  08,  09 

1 

3 

X 

X 

B 

1 

01B, 02B, 03B 

1 

4 

X 

X 

X 

B 

2 

04B, 05B, 06B 

2 

5 

X 

X 
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B  3  07B, 08B, 09B 


6  X 


X 


Three  orthopox  positive  NHP  blood  samples  (obtained  from  days  2,  5,  and 
8  post  monkeypox  virus  exposure)  obtained  from  a  previous  animal  study  were 
chosen  to  represent  high,  medium  and  low  viral  titers,  respectively.  DNA  was 
extracted  previously  and  GC  values  were  determined  while  the  animal  study  was 
in  progress.  Standards,  controls,  and  test  samples  were  assayed  on  eight  of 
nine  runs.  Volumes  for  D2  (low),  D5  (medium)  and  D8  (high)  test  samples  were 
not  of  sufficient  volume  to  complete  the  ninth  run  (09)  of  the  Set  A  assays.  The 
ninth  run  was  completed  with  a  substitute  sample,  but  the  data  was  not  utilized 
for  determination  of  precision.  Instead,  the  standard  curve  data  was  collected 
and  applied  to  the  Verification  of  the  Standard  Curve  data  set.  Since  nine  runs 
were  required  to  evaluate  intermediate  precision,  high,  medium  and  low  test 
samples  for  Set  B  assays  were  prepared  by  spiking  negative  control  serum 
(NCS)  with  stock  monkeypox  virus,  extracted  and  run  on  the  LightCycler. 

This  assay  showed  acceptable  levels  of  precision  for  all  standards  and  test 
samples  with  >  50  GC/5uL  (1 0,000  GC/mL).  All  mean  GC  values  for  each 
acceptable  HA  standard  as  determined  for  each  assay  had  a  %CV  ranging  from 
0.52  to  21 .88,  passing  the  acceptance  criteria  for  repeatability  and  intermediate 
precision  (Suppl.  Tables  1  and  2).  Positive  test  samples  that  were  above  the 
lower  limit  of  quantitation  (LLOQ,  see  “Accuracy”)  that  ranged  from  4.93  x  103to 
7.42  x106GC/5uL  also  exhibited  acceptable  repeatability  (with  the  exception  of 
assay  #1)  and  intermediate  precision.  In  terms  of  repeatability,  the  %CV  for  all 
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PTS  with  medium  range  GC  values  ranged  from  8.82  to  35.40.  The  %CV  for  all 
PTS  with  high  range  GC  values  ranged  from  1 0.41  to  31 .97  (Suppl.  Table  1 ).  For 
intermediate  precision  testing,  %CV  for  PTS  with  medium  range  and  high  GC 
values  ranged  from  15.13  to  28.90%  and  15.67  to  25.40%,  respectively  (Suppl. 
Table  2). 

All  positive  extraction  values  tested  in  duplicate  for  each  run  met  the  acceptance 
criteria  as  established  in  Table  1 .  The  %CV  for  all  PEC  tested  in  the  6 
repeatability  assays  ranged  from  22.30  to  42.15  (Suppl.  Table  1).  The  %CV  of 
the  PEC  in  all  four  intermediate  precision  assays  ranged  from  22.20  to  48.30. 

The  PEC  failed  repeatability  and  intermediate  precision  (same  analyst)  in  Assay 
#3  (%CV  of  42.15%,  Suppl.  Table  1)  and  Assay  1/3  (%CV  of  48.30%,  Suppl. 
Table  2),  respectively.  Since  the  PEC  is  primarily  used  to  verify  that  samples  are 
extracted  properly,  we  deemed  it  more  important  that  the  values  for  the  PEC  fall 
within  the  predetermined  range  (1 .58x1 03  to  1 .58x1 04  GC/5uL).  Furthermore,  the 
high  %CV  appeared  to  be  due  to  technician  error.  Together,  the  overall  precision 
of  this  assay  utilizing  the  FIA  standards,  PTS,  and  PEC  is  acceptable  for  its 
intended  use. 


Verification  of  Selectivity 


TR-17-122 

Distribution  Statement  A:  Approved  for  public  release;  distribution  is  unlimited. 


Selectivity,  as  defined  by  FDA  guidance,  is  “...the  ability  of  an  analytical 
method  to  differentiate  and  quantify  the  analyte  in  the  presence  of  other 
components  in  the  sample”  [8].  In  this  study,  the  other  components  are  those 
remaining  in  the  extracted  blood.  Therefore,  selectivity  was  verified  by  spiking 
14  negative  test  samples  (NTS1-14)  with  monkeypox  virus  DNA  (NCS  spiked 
with  1 .1x10s  GC/5pl).  Negative  test  samples  (NTS)  were  first  assayed  to  verify 
the  presence  or  absence  of  orthopox  DNA  and  dropped  if  orthopox 
contamination  (>LLOQ)  was  present.  The  GC  value  of  the  spiked  water  sample 
provided  the  reference  value  used  for  calculating  recovery.  Three  assays,  each 
consisting  of  2  runs  were  completed.  Given  the  intended  use  of  the  assay  the 
selectivity  was  deemed  acceptable  when  the  recovery  of  each  spiked  sample 
was  between  80  and  120%. 

After  spiking  with  viral  DNA  (approximately  1x10s  GC),  4  of  12  tested 
samples  gave  rise  to  recovery  values  (75%,  75%,  77%,  75%)  below  the  limits  set 
in  the  acceptance  criteria  (Suppl.  Table  3).  The  remaining  spiked  samples 
resulted  in  recovery  values  ranging  from  80%  to  87%.  Based  on  this 
observation,  matrix  effects  likely  had  a  dampening  effect  on  all  samples  tested. 
Based  on  the  data  (Suppl.  Table  3),  one  could  reasonably  expect,  and  should 
account  for,  at  least  a  13%  loss  in  signal  and  as  much  as  a  25%  loss. 


Verification  of  Accuracy 
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“The  accuracy  of  an  analytical  method  describes  the  closeness  of  mean 
test  results  obtained  by  the  method  to  the  true  value...”  or  accepted  reference 
value[8].  Titration  of  poxvirus(es)  by  plaque  assay  is  traditionally  implemented  to 
determine  viral  load  (the  amount  of  virus  in  blood  or  tissue).  This  method 
depends  strongly  on  the  quality  and  consistency  of  a  live  culture  system  (cell 
culture),  requires  multiple  days  before  data  can  be  acquired,  and  has  limited 
sensitivity.  In  the  case  of  monkeypox  virus,  material  must  be  handled  in  a 
biological  safety  level  three  (BSL-3)  laboratory  by  properly  trained  individuals, 
whereas  inactivating  the  samples  allows  subsequent  processing  in  a  more 
accessible  environment.  Inactivating  the  sample  has  drawbacks,  namely, 
determination  of  infectious  units  is  no  longer  possible  and  the  integrity  of  nucleic 
acids  may  be  affected. 

In  our  study  three  methods,  identified  as  A,  B,  and  C,  were  used  to  test 
accuracy  (Table  3).  Each  method  consisted  of  3  assays  and  each  assay 
consisted  of  3  Lightcycler  runs  with  an  acceptable  recovery  range  of  50-150%. 
This  range  was  purposefully  broad  to  represent  the  application  for  which  it  was 
intended,  that  is,  quantitation  of  viremia  from  monkeypox  exposed  cynomolgus 
macaques.  It  is  unlikely  that  a  potential  therapeutic  will  be  judged  as  efficacious 
by  a  slim  margin  in  viremia  compared  to  placebo  or  another  treatment,  or,  for  that 
matter,  by  viremia  alone.  Therefore  we  found  this  range  to  be  more  in  line  with  a 
“real  world  scenario”  of  meaningful  viral  DNA  quantity  comparisons. 
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Table  3:  An  overview  of  accuracy  testing  by  three  methods. 


Set 

Method 

Assay 

Reference  Values 

A 

Negative  blood  spiked 

(3  LC  runs  per  assay) 

1,2,3 

Converted  pfu  to  GC/ml 

B 

with  MPX  vims 

Negative  blood  spiked 

1,2,3 

Used  GC  values  from  Set  A 

C 

with  extracted  DNA 

Negative  blood  spiked 

1,2,3 

Used  GC  values  from  Set  C 

with  extracted  DNA 

Method  A  used  NCS  spiked  with  a  1  to  10  serial  dilution  (IxlO3  pfu/ml  to 
1x10s  pfu/ml)  of  stock  monkeypox  virus.  The  spiked  NCS  was  extracted  and 
amplified  on  the  LightCycler  (9  runs).  Mean  GC  values  were  determined  for  each 
assay  and  compared  to  the  reference  values.  The  reference  value,  as 
determined  by  plaque  assay  titration  (data  not  shown)  was  converted  from 
pfu/mL  to  GC/5  pi  by  dividing  the  pfu/ml  of  the  diluted  virus  stock  samples  by  200 
and  then  multiplying  by  a  previously  resolved  conversion  factor,  13  (data  not 
shown).  The  mean  recovery  value  per  assay  was  determined  for  each  sample. 

Of  the  concentrations  evaluated  (NCS  spike  with  108  pfu/mL  to  103  pfu/mL),  all 
but  1/3  NCS  spiked  with  104pfu/mL  (2/3  assays,  Suppl.  Table  4)  passed 
recovery.  This  was  most  likely  due  to  technical  error  as  samples  at  lower  spiked 
concentrations  met  criteria  and  were  acceptable. 

Method  B  avoided  the  conversion  of  PFU  to  GC.  Extracted  DNA  from 
method  A  was  prepared  for  spiking  NCS  to  give  an  approximate  range  of  1x10s 
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to  IxlO8  GC/ml.  The  spiked  NCS  was  extracted  and  tested  in  9  runs.  The  GC 
values  for  reference  standards  used  in  Set  B  were  calculated  from  serial  dilutions 
of  extracted  DNA  obtained  in  Set  A.  The  mean  recovery  value  per  sample  was 
determined  for  each  assay.  For  this  method,  NCS  spiked  at  lx  105  GC/ml 
through  1  xl  08  GC/ml  met  all  of  the  acceptance  criteria  for  each  run  and  passed 
all  recovery  tests.  The  IxlO4  GC/ml  and  IxlO3  GC/ml  material  failed  recovery 
in  1  of  3  and  2  of  3  assays,  respectively  (Suppl.  Table  4). 

Because  there  was  a  lack  of  consistency  in  the  IxlO3  GC/ml  spiked 
samples,  we  repeated  the  method  with  a  single  modification.  Method  C  also 
used  NCS  spiked  with  extracted  DNA  from  method  A,  but  the  reference  material 
was  extensively  tested  to  yield  a  more  exact  concentration.  After  dilution,  the 
reference  material  that  was  consistent  with  the  acceptance  criteria  was  deemed 
suitable  as  Reference  samples.  Dilutions  that  did  not  fall  within  acceptable 
ranges  were  dropped  from  further  use.  NCS  was  spiked  with  the  Reference 
samples,  extracted  and  tested  in  9  runs.  The  mean  recovery  value  per  assay 
was  determined  for  each  sample.  Here,  the  NCS  spiked  with  9.92x10°,  9.92x1 02, 
9.92x1 03,  8.41  xl  04,  and  8.41  xl  05  GC  met  all  of  the  acceptance  criteria  for  each 
run.  All  spiked  NCS  passed  recovery  testing  in  all  assays  with  values  ranging 
from  52%  to  117%  (Suppl.  Table  4). 

It  should  be  noted  that  for  samples  <  50  GC,  the  %CV  per  run  was  often 
above  our  threshold  (<  30%).  This  is  not  surprising  as  this  is  below  our 
demonstrated  limit  of  quantification  (as  will  be  discussed  in  the  next  section) 


Verification  of  the  Standard  Curve 
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A  standard  curve  with  defined  detection  and  quantifiable  limits  (i.e.,  ULOQ, 

LLOQ,  and  LOD)  was  a  requirement  for  the  Orthopox  assay  validation.  The  cloned 
Variola  Bangladesh  (VARV-BSH)  HA  gene  was  used  as  the  standard  curve  for  this 
assay.  The  sequences  used  within  the  HA  gene  are  well  conserved  among 
orthopoxviruses  [7],  Although  the  preference  was  to  spike  monkeypox  virus  into 
nonhuman  primate  blood,  we  chose  to  use  the  HA  standard  after  considering  the 
potential  biological  safety  and  logistical  issues  with  this  procedure.  Furthermore,  the 
DNA  standard  could  be  produced  in  bulk  and  concentrations  established  by  established, 
accepted  methods  (e.g.,  spectrophotometry)  ensuring  less  variation  between  lots. 

Three  assays,  each  comprised  of  3  LightCycler  runs,  were  performed  to  test 
consistency  and  identify  the  limits  of  detection  (LOD)  and  quantitation  (LOQ).  The 
upper  and  lower  limit  of  quantitation  (ULOQ  and  LLOQ)  is  the  highest  and  lowest 
amount  of  an  analyte  in  a  sample  that  can  be  quantified  with  acceptable  precision  and 
accuracy,  respectively  (8).  Concentrations  of  HA  ranging  from  1x10_1GC/5ul  to  IxlO10 
GC/5  pi  (samples  bsh-ha-0.1  to  bsh-ha-9.0)  were  prepared  and  evaluated  in  triplicate 
(Suppl.  Table  5).  Recovery  values  and  CVs  were  determined  for  each  concentration. 

In  order  to  meet  the  criteria,  the  LLOQ  and  ULOQ  must  be  detectable  in  3  out  of  3  tests 
(9  runs),  have  a  %CV  <30,  and  recovery  between  80%  and  120%.  The  stringent 
recovery  range  was  implemented  due  to  the  fact  that  the  HA  standard  was  not  being 
extracted.  The  LOD  was  defined  as  the  number  of  genomes  resulting  in  detection  in  2 
out  of  3  tests  (6  out  of  9  runs).  Stability  of  the  HA  Standards  over  time  was  determined 
from  the  mean  daily  efficiency  values  for  the  entire  study  (Suppl.  Table  6). 
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The  HA  Standard  containing  approximately  2.5  GC/5  pi  was  detected  in  6  out  of 
9  runs  and  met  the  criteria  for  the  LOD  (Suppl.  Table  5).  The  HA  Standard  dilution 
containing  approximately  5x1 01  GC  met  the  LLOQ  criteria  by  detection  in  3  out  of  3 
tests  (9  of  9  runs),  a  %CV  of  22.23,  13.40,  and  12.94;  and  a  mean  recovery  value  of 
1 06.  The  HA  Standard  dilution  containing  approximately  5x  1 07  GC  met  the  ULOQ 
criteria  by  detection  in  3  out  of  3  tests,  a  %CV  of  1 .81 , 2.44,  and  3.03;  and  a  mean 
Recovery  value  of  1 17.  The  mean  daily  efficiency  values  of  the  HA  Standards  ranged 
from  1 .91 1  to  1 .998  with  a  %CV  ranging  from  0.050  to  3.433  (Suppl.  Table  6).  In  terms 
of  stability  of  the  standard  curve,  the  mean  efficiency  value  for  the  entire  study  was  2.0 
with  a  %CV  of  1 .1 ,  suggesting  stability  of  the  HA  standards  for  at  least  92  days. 

Verification  of  Stability 

Stability  testing  examines  the  precision  of  the  assay  (and  components)  over  time 
or  when  variations  are  introduced.  The  primary  concerns  for  this  assay  were  the 
potential  effect  of  freeze/thaw  cycles  on  the  HA  DNA  standard  and  the  long  term 
stability  of  the  PEC  and  PCR  Master  Mix  (MGB  Master  Mix). 

Three  assays  were  used  to  test  the  stability  of  the  pan-orthopox  virus  HA  MGB 
assay.  The  first  assay  tested  viral  DNA  stability  by  evaluating  the  freeze  thaw  effect  on 
GC  values.  Three  concentrations  of  HA  standards  (5x1 02,  5x1 04  and  5x1 06  GC/5pL), 
PEC,  and  PTS  were  freeze  thawed  10  times  and  tested  following  the  1st,  5th,  and  10th 
freeze  thaws.  The  PEC  was  extracted  prior  to  freeze  thaw  and  the  PTS  was  extracted 
following  freeze  thaw.  The  %CV  was  determined  from  the  3  runs  for  each  sample.  The 
second  assay  tested  PEC  stability  over  time  by  comparing  GC  values  from  a  previous 
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protocol  to  that  of  a  current  lot,  which  was  prepared  4  months  later.  Two  samples  from 
each  lot  were  tested  in  duplicate  per  run  and  the  CV  was  determined  for  the  mean  GC 
values.  The  third  assay  tested  the  stability  of  MGB  Master  Mix  by  comparing  the  GC 
values  of  HA  Standards  (5x1 02,  5x1 04  and  5x106GC/5ul_)  assayed  with  two  different 
lots  of  Master  Mix  that  were  temporally  separated  by  8  months.  The  CV  was 
determined  from  the  3  HA  Standards  tested  in  duplicate. 

All  of  the  assays  met  acceptance  criteria.  The  3  concentrations  of  HA  Standards 
subjected  to  freeze-thaw  had  %CVs  of  4.52,  1 .94,  and  1 1 .75  (Suppl.  Table  7).  The 
PEC  and  PTS  subjected  to  freeze-thaw  had  %CVs  of  35.75  and  20.86,  respectively. 

The  %CV  from  testing  different  lots  of  PEC  was  1 7.01 .  Preparing  3  concentrations  of 
HA  Standards  with  different  lots  of  MGB  Master  Mix  resulted  in  %CVs  of  12.87,  1 1 .58, 
and  1 6.61 .  Together,  these  data  support  that  there  is  little  or  no  effect  of  freeze  thaw 
cycles  on  the  HA  standard  and  the  PEC  and  MGB  Master  mix(es)  are  stable  for  at  least 
4  and  8  months,  respectively. 

Verification  of  Specificity 

Specificity  tests  the  ability  of  the  assay  to  identify  a  specific  analyte  within  the 
test  matrix.  In  this  section,  orthopox  virus  DNA  was  the  analyte  and  MGB  Master  Mix 
was  the  matrix.  DNA  isolated  from  herpes  simplex  virus-1  (HSV-1),  herpes  simplex 
virus-2  (HSV-2),  camelpox,  vaccinia,  rabbitpox,  and  cowpox  viruses  were  obtained  from 
the  Diagnostic  Systems  Division,  at  USAMRIID.  A  more  extensive  panel  has  been 
tested  [7],  therefore  we  focused  on  DNA  samples  that  were  representative  of  viruses 
being  utilize  in  our  lab.  A  1 :1 00  dilution  of  each  isolate  was  prepared  and  both  the 
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diluted  and  undiluted  preparations  of  were  tested  in  duplicate  using  the  MGB  Master 
Mix. 

All  MGB  Master  Mix  samples  spiked  with  orthopox  virus  DNA  (camelpox, 
vaccinia,  rabbitpox,  and  cowpox  viral  DNA),  tested  positive  (Suppl.  Table  8).  MGB 
Master  Mix  samples  spiked  with  non-orthopox  viral  DNA,  HSV1  and  the  diluted  sample 
of  HSV2,  tested  negative.  The  undiluted  sample  of  HSV-2  gave  rise  to  low  levels  (3  to  8 
GC/5  ul)  of  Orthopox  GC.  Further  testing  utilizing  a  monkeypox  specific  PCR  assay  [9] 
indicated  that  the  HSV-2  sample  contained  monkeypox  DNA  contamination  (data  not 
shown). 

Verification  of  Robustness 

Robustness  tests  the  ability  of  an  assay  to  remain  unaffected  by  small  but 
deliberate  changes  and  provides  an  indication  of  its  reliability  during  normal  usage. 
Three  assays,  each  consisting  of  2  LightCycler  runs,  were  used  to  test  the  effect  of  2 
lots  of  MGB  Master  Mix,  2  lots  of  Qiagen  extraction  kits,  and  2  LightCyclers,  on  the  GC 
values  (Table  4).  HA  Standards  and  aliquots  of  the  PEC  were  used  to  test  2  lots  of 
MGB  Master  Mix  by  determining  the  %CV  of  GC  values  from  LightCycler  runs  VP42 
and  VP44  (Lot  B)  and  again  from  runs  VP43  and  VP45  (Lot  A),  where  the  other 
parameters  (extraction  kit  lot  and  LightCycler  instrument)  were  held  constant.  We  found 
that  all  of  the  VARV-BSH  standards  and  the  three  aliquots  of  PEC  met  the  acceptance 
criteria  (Table  1 )  with  a  %CV  ranging  from  1 .32  to  23.39  and  23.60  to  39.86, 
respectively  (Suppl.  Table  9).  The  PEC  failed  the  acceptance  criteria  in  assay  #1  with  a 
%CV  of  47.44  but  passed  in  assay  #2  with  a  %CV  of  22.78. 
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Table  4:  Overview  of  robustness  testing. 


Extraction 

MGB  Master 

LightCycler 

Assay  ID 

Kits 

Mix-orthopox 

Instruments 

Serial  # 

VP42 

Lot#l 

Lot  B 

1403531 

VP42B 

Lot#l 

Lot  B 

1403531 

VP43 

Lot#l 

Lot  A 

1403531 

VP43B 

Lot#2 

Lot  B 

1403531 

VP44 

Lot#l 

Lot  B 

1403649 

VP45 

Lot#l 

Lot  A 

1403649 

Aliquots  of  the  PEC  were  used  to  test  different  lots  of  Qiagen  kits  by  determining 
the  %CV  of  GC  values  from  runs  VP42B  and  VP43B  in  which  only  the  Qiagen  kit  lot 
was  changed.  Each  aliquot  of  the  PEC  was  prepared  by  extracting  over  a  column  from 
one  of  the  two  kits.  Aliquots  A,  B,  and  C  were  extracted  using  “Lot  #1”  whereas  D,  E, 
and  F  were  extracted  with  “Lot  #2”.  Aliquots  A,  B,  and  C  were  tested  in  duplicate  in  run 
VP42B  and  aliquots  D,  E,  and  F  were  tested  in  duplicate  in  run  VP43B.  Aliquot  B  had  a 
GC  value  of  4.07x1 04  whereas  the  other  aliquots  had  values  ranging  from  1 .20x1 04  to 
1 .67x1 04.  Aliquot  B  was  dropped  from  further  calculations  as  an  outlier  using  Dixon’s 
Gap  Analysis  [10].  The  %CV  of  the  mean  GC  value  for  all  aliquots  in  each  assay  was 
18%  and  8.7%,  and  for  both  assays  was  13%,  meeting  the  acceptance  criteria  (Table  1 
and  Suppl.  Table  10) 

HA  Standards  and  aliquots  of  the  PEC  were  used  to  test  the  two  LightCyclers  by 


determining  the  %CV  of  GC  values  from  runs  VP42  and  VP44  and  again  from  runs 
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VP43  and  VP45  (Table  4).  All  tests  met  the  acceptance  criteria  with  %CV  ranging  from 
1 .06  to  25.6%  (Suppl.  Table  1 1 ). 

From  the  robustness  testing,  we  found  that  implementing  different  Master  Mix 
lots,  Qiagen  extraction  kit  lots,  or  changing  instruments  did  not  impact  the  performance 
of  the  assay. 

Conclusion 

Here  we  present  a  quantitative  real  time  PCR  assay  validated  for  the 
determination  of  monkeypox  viral  GC  levels  in  cynomolgus  macaque  EDTA  whole  blood 
(Table  5).  The  assay  was  designed  to  support  the  near-real-time  monitoring  of  viral 
load  and  to  facilitate  comparison  of  viral  load  in  nonhuman  primate  studies.  Since 
validation  is  an  essential  component  of  a  GLP  study  environment,  it  was  necessary  to 
establish  the  operational  parameters  of  this  assay.  Precision,  selectivity,  accuracy, 
limits  of  detection,  stability,  specificity,  and  robustness  were  examined  utilizing  samples 
representative  of  those  obtained  during  normal  experimental  procedures.  HA 
Standards  and  test  samples  demonstrated  acceptable  levels  of  precision  (<  30%  CV) 
with  >  50  GC/5pL  of  blood.  The  detection  of  PTS  with  GC  values  <  50  and  high  CVs 
noted  throughout  the  study  further  supported  the  standard  curve  data  for  placing  the 
LLOQ  at  50  GC/5  pi  and  the  LOD  at  2.5  GC/5  pi.  PEC  values  with  %CV  >  40%  were 
deemed  acceptable  due  to  this  control  serving  as  verification  for  the  extraction 
procedure.  Matrix  effects  due  to  the  components  that  remained  from  extracted 
cynomologus  macaque  blood  were  detected,  suggesting  the  selectivity  of  the  assay  can 
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be  influenced  by  substances  that  are  co-extracted  with  the  DNA  and  that  GC  values  are 
actually  higher  (<  25%)  than  measured.  High  PCR  sensitivity  resulted  in  technical 
problems  for  the  first  two  methods  attempted  to  test  the  accuracy  but  the  third  method 
clearly  shows  GC  >  10  /5  pi  meeting  the  acceptance  criteria.  Since  a  wide  range  of 
virema  occurs  during  poxvirus  infection  (from  0  GC/ml  in  uninfected  controls  to  >  1 07 
GC/ml  in  animals  with  severe  disease),  a  recovery  of  50  to  150%  is  sufficient  for 
detecting  differences  >  0.5  log.  The  amplification  was  specific  for  orthopox  virus 
genomes,  and  identified  a  previously  unsuspected  poxvirus  contamination  of  a  HSV-2 
sample.  Based  on  the  validation  results,  the  pan-orthopox  HA  MGB  assay  can  be  used 
to  assess  orthopox  viral  load  by  quantitating  the  copies  of  HA  gene  present  in  a  NHP 
(cynomolgus  macaque)  EDTA  blood  sample.  Given  the  need  for  regulated  studies  and 
supporting  validated  assays  for  the  evaluation  of  orthopox  countermeasures,  our  pan¬ 
orthopox  HA  MGB  assay  (in  the  context  of  this  validation)  will  be  integral  for  the 
progression  and  potential  FDA  licensing  of  current  and  future  orthopox  therapeutics. 


Table  5:  Summary  of  findings  for  Orthopox  DNA  PCR 


Parameter 

Conclusion 

Precision 

Repeatability 

Intermediate 

Acceptable  when  GC/5uL  is 
>  LLOQ 

Selectivity 

Matrix  effects  of  13-25% 
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Accuracy 

within  50-150%  (when> 
LLOQ) 

Standard  Curve 

LOD:  2.5  GC/5uL 

LLOQ:  50  GC/5uL 
ULOQ:  5xl07  GC/5uL 
Efficiency:  2.0  ±  0.2 
Stability:  >  92  days 

Stability 

HA  standards 

PEC 

Master  Mix 

stable  after  10  freeze  thaws 

stable  for  at  least  4  months 

stable  for  at  least  8  months 

Specificity 

orthopox  specific  [7] 

Robustness 

no/little  effect  when 
changing  extraction  kit  lots, 
Master  Mix  lots,  or 
LightCycler  instruments 
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Supplemental  Data 

Supplemental  Table  1:  Repeatability  for  each  of  the  6  assays.  N  =  3  unless  stated  otherwise. 

Assay  1  Assay  2  Assay  3  Assay  IB  Assay  2B  Assay  3B 


Mean 

%CV 

Mean 

%CV 

Mean 

%CV 

Mean 

%CV 

Mean 

%CV 

Mean 

%cv 

Sample 

GC/5uL 

GC/5uL 

GC/5uL 

GC/5uL 

GC/5uL 

GC/5uL 

5x  106  HA  Standard 

4.91x  106 

3.37 

4.97x  106 

1.5 

5.03x  106 

1.04 

5.31x  106 

2.76 

5.23x  106 

1.1 

5.26x  106 

0.7 

5x  105  HA  Standard 

4.97x  105 

3.85 

5x  104  HA  Standard 

5.31x  104 

6.01 

5.11x  104 

2.12 

5.06x  104 

4.31 

5.25x  104 

1.14 

5.26x  104 

1.32 

5.30x  104 

0.99 

5x  103  HA  Standard 

4.55x  103 

7.75 

5x  102  HA  Standard 

4.84x  102 

*5.12 

5.23x  102 

1.65 

5.10x  102 

1.19 

5.58x  102 

3.27 

5.71x  102 

2.56 

5.85x  102 

1.2 

5x  101  HA  Standard 

5.47x  101 

21.88 

4.91x  101 

1.26 

2.8 

4.92x  101 

2.26 

4.82x  101 

0.81* 

4.74x  101 

0.52* 

PEC 

4.63x  103 

39.57 

4.11x  103 

22.99 

2.60x  103 

42.15 

6.79x  103 

24.84 

7.31x  103 

23.98 

8.15x  103 

22.3 

D8  (high) 

1.79x  105 

31.97 

1.68x  105 

17.17 

1.57x  105 

11.75* 

NA 

NA 

NA 

NA 

NA 

NA 

D5  (medium) 

5.86x  103 

35.4 

5.48x  103 

19.2 

4.93x  103 

13.07* 

NA 

NA 

NA 

NA 

NA 

NA 

D2  (low) 

2.02x  10° 

34.08 

1.58x  10° 

64.93 

2.87x  10° 

53.39* 

NA 

NA 

NA 

NA 

NA 

NA 

NCS  +  virus  (high) 

NA 

NA 

NA 

NA 

NA 

NA 

7.42x  106 

10.41 

6.28x  106 

18.21 

6.84x  106 

24.84 

NCS  +  virus 

(medium) 

NA 

NA 

NA 

NA 

NA 

NA 

6.29x  104 

8.82 

5.65x  104 

21.12 

6.42x  104 

23 

NCS  +  virus  (low) 

NA 

NA 

NA 

NA 

NA 

NA 

2.97x  101 

23.66 

2.47x  101 

83.81 

3.05x  101 

49.03 

Bold  font  indicates  results  outside  range  of  acceptance  criteria. 


*  Indicates  N=2 
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Supplemental  Table  2:  Intermediate  precision  testing.  N  =  6  unless  stated  otherwise. 

Same  Analyst  Different  Analyst 


Assay  1  &  2 

Assay  IB  &  2B 

Mean 

GC/5 

Ml 

%c 

V 

Mean 

GC/5  ul 

%CV 

4.94x  106 

2.43 

5.27x  106 

2.07 

5.21x  104 

4.59 

5.25x  104 

1.11 

4.83x  103 

6.06 

4.43x  103 

5.06 

5.07x  102 

4.51 

5.64x  102 

2.91 

2.66 

4.88x  101 

2 

4.37x  103 

30.52 

7.05x  103 

22.2 

1.73x  105 

23.62 

NA 

NA 

5.67x  103 

26.2 

NA 

NA 

1.80x  10° 

45.44 

NA 

NA 

NA 

NA 

6.85x  106 

15.67 

NA 

NA 

5.97x  104 

15.13 

NA 

NA 

2.72x  101 

51.81 

Assay  1  &  3 

Assay  IB  &  3B 

Mean 

GC/5 

Ml 

%cv 

Mean 

GC/5  ul 

%cv 

4.97x  106 

2.57 

5.28x  106 

1.88 

5.19x  104 

5.38 

5.27x  104 

1.08 

4.72x  103 

6.2 

4.48x  103 

3.56 

5.01x  102 

3.55 

5.71x  103 

3.44 

4.86x  101 

15.71 

4.85x  102 

2.56 

3.61x  103 

48.3 

7.47x  103 

23.26 

1.70x  105 

25.40* 

NA 

NA 

5.48x  103 

28.90* 

NA 

NA 

2.36x  10° 

43.14* 

NA 

NA 

NA 

NA 

7.13x  106 

17.14 

NA 

NA 

6.35x  104 

15.73 

NA 

NA 

3.01x  10' 

34.71 

Sample 

Standard  5x  106 

Standard  5x  104 

Standard  5x  103 

Standard  5x  102 

Standard  5x  101 

PEC 

D8  (high) 

D5  (medium) 

D2  (low) 

NCS  +  virus  (high) 

NCS  +  virus 

(medium ) 

NCS  +  virus  (low ) 

Bold  font  indicated  results  outside  range  of  acceptance  criteria. 


*  indicates  N=5. 
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Supplemental  Table  3:  Selectivity  testing  of  spiked  NTS 


Test  Sample 

N 

%  Recovery 

NTS  1  +  PTS 

4 

83 

NTS2  +  PTS 

4 

75 

NTS  3  +  PTS 

4 

75 

NTS4  +  PTS 

4 

83 

NTS5  +  PTS 

4 

87 

NTS6  +  PTS 

4 

80 

NTS7  +  PTS 

4 

82 

NTS  8  +  PTS 

4 

80 

NTS  1 1  +  PTS 

4 

75 

NTS  12  +  PTS 

4 

84 

NTS  13  +  PTS 

4 

84 

NTS  14  +  PTS 

4 

77 

Bold  font  indicated  results  outside  range  of  acceptance  criteria. 
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Supplemental  Table  4:  Accuracy  testing  by  3  methods.  (N=3  per  assay) 


Assay:  #1 

#2 

#3 

Reference  Samples 

%  Recovery 

% 

% 

Spiked 

Recovery 

Recovery 

NCS 

N=9 

Method  A 

-pfu/ml 

~GC/5ul 

GC/5ul 

lx  10s 

6.5x  106 

56.90 

67.34 

90.05 

4.65x  106 

lx  107 

6.5x  105 

78.67 

67.64 

98.10 

5.30x  105 

lx  106 

6.5x  104 

97.23 

81.23 

80.21 

5.60x  104 

lx  105 

6.5x  103 

78.87 

64.01 

107.87 

5.43x  103 

lx  104 

6.5x  102 

41.67 

44.64 

50.18 

2.96x  102 

lx  103 

6.5x  101 

53.23 

92.54 

94.38* 

5.20x  101 

Method  B 

~GC/ml 

~GC/5ul 

lx  10s 

5. Ox  105 

50.53 

85.87 

97.46 

4.02x  105 

lx  107 

5. Ox  104 

50.73 

74.73 

102.16 

3.76x  104 

lx  106 

5. Ox  103 

61.37 

105.73 

94.96 

4.90x  103 

lx  105 

5. Ox  102 

58.33 

95.37 

76.72 

4.58x  102 

lx  104 

5  .Ox  101 

39.57 

80.00 

89.01 

1.05x  102 

lx  103 

5. Ox  10° 

13.97 

74.32 

339.57 

2.04x  101 

Method  C 

GC/5ul 

8.41x  105 

81.59 

92.89 

97.46 

7.62x  105 

8.41x  104 

85.14 

108.52 

102.16 

8.29x  104 

9.92x  103 

78.99 

91.09 

94.96 

8.77x  103 

9.92x  102 

52.45 

64.10 

76.72 

6.40x  102 

9.92x  101 

49.76 

70.31 

89.01 

6.91x  101 

9.92x  10° 

70.58 

101.33 

116.51 

5.98x  10° 

Bold  font  indicated  results  outside  range  of  acceptance  criteria. 


*N=2, 
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Supplemental  Table  5:  Standard  curve  assessment 


Cone,  of 

Assay  #1 

Assay  #2 

Assay  #3 

MEAN 

Test 

Mean 

% 

Mean 

% 

Mean 

% 

% 

Samples 

Det 

GC/5ul 

cv 

Det  GC/5ul 

CV 

Det 

G 

Q 

P 

CV 

Recovery 

GC/5ul 

Bsh-ha-9.0 

0/3 

Out  of  range 

NA 

0/3 

Out  of  range 

NA 

0/3 

Out  of  range 

NA 

NA 

Bsh-ha-8.0 

3/3 

6.64x  10s 

0.57 

3/3 

5.76x  10s 

0.30 

3/3 

5.77x  10s 

2.76 

121.18 

Bsh-ha-7.0 

3/3 

6.61x  107 

1.81 

3/3 

5.65x  107 

2.44 

3/3 

5.36x  107 

3.03 

117.49 

Bsh-ha-6.0 

3/3 

6.20x  106 

0.97 

3/3 

5.17x  106 

1.02 

3/3 

5.44x  106 

2.30 

112.07 

Bsh-ha-5.0 

3/3 

5.30x  106 

0.61 

3/3 

5.47x  10s 

1.87 

3/3 

5.50x  105 

3.15 

108.51 

Bsh-ha-4.0 

3/3 

5.37x  105 

0.65 

3/3 

5.48x  104 

1.11 

3/3 

5.66x  104 

1.41 

110.04 

Bsh-ha-3.0 

3/3 

5.70x  104 

1.47 

3/3 

5.57x  103 

1.97 

3/3 

5.46x  103 

1.47 

111.53 

Bsh-ha-2.0 

3/3 

5.73x  103 

4.09 

3/3 

5.39x  102 

4.39 

3/3 

5.49x  102 

2.42 

110.78 

Bsh-ha-1.0 

3/3 

5.40x  102 

22.23 

3/3 

5.50x  101 

13.40 

3/3 

5.02x  101 

12.94 

106.18 

Bsh-ha-0.5 

3/3 

5.45x  10° 

40.78 

3/3 

1.52x  10° 

40.57 

3/3 

1.77x  10° 

48.36 

58.32 

Bsh-ha-0.25 

1/3 

3.68x  10° 

57.74 

3/3 

2.08x  10° 

24.96 

2/3 

3.97x  10° 

58.37 

129.69 

Bsh-ha-0.1 

2/3 

1.41x  10° 

60.19 

1/3 

8.99x  10° 

57.74 

1/3 

6.00x  10*1 

57.74 

193.93 

Det  =  Detected, 

Bold  font  indicated  results  outside  range  of  acceptance  criteria. 


*N=1,  **N=2, 


TR-17-122 

Distribution  Statement  A:  Approved  for  public  release;  distribution  is  unlimited. 


Supplemental  Table  6:  Stability  of  the  HA  Standard 


Days 

N 

Daily  Mean 

%CV 

Efficiency  values 

0 

3 

1.957 

1.067 

1 

5 

1.929 

1.128 

2 

7 

1.952 

0.483 

5 

3 

1.958 

0.771 

6 

3 

1.952 

0.237 

7 

5 

1.947 

0.547 

8 

3 

1.950 

0.320 

9 

4 

1.954 

0.975 

12 

1 

1.919 

NA 

13 

3 

1.938 

0.947 

15 

6 

1.943 

0.550 

16 

3 

1.932 

0.467 

17 

4 

1.921 

0.611 

21 

4 

1.983 

1.032 

22 

3 

1.911 

3.433 

23 

3 

1.980 

0.127 

27 

6 

1.956 

1.659 

28 

2 

1.957 

1.936 

36 

2 

1.957 

1.951 

37 

4 

1.958 

2.839 

38 

5 

1.941 

2.209 

90 

3 

1.991 

0.050 

91 

2 

1.998 

0.212 

Total 

84 

Mean  Efficiency 

1.952 

Overall  %CV 
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Supplemental  Table  7:  Stability  testing  of  HA  Standard,  PEC,  and  MGB  Master  Mix 


%CV 


Freeze  thawed 

PEC  Lots  #1  and  #2 

MGB  Lots  A  and  B 

Test  Samples 

(Ne3) 

(N=4) 

(Ne4) 

106STD 

4.52 

NA 

12.87 

io4std 

1.94 

NA 

11.58 

io2std 

11.58 

NA 

16.61 

PEC 

35.75 

17.01 

NA 

PTS  (NCS  +  vims) 

20.86 

NA 

NA 

NA  =  Not  tested 
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Supplemental  Table  8:  Specificity  testing  using  different  viral  DNA 


Virus 

GC/  5  ul 

HSV-1 

Not  detected 

HSV-1  diluted 

Not  detected 

HSV-2 

5.26 

HSV-2  diluted 

Not  detected 

Camelpox 

3.90x  104 

Camelpox  diluted 

3.12x  102 

Vaccinia 

1.65x  103 

Vaccinia  diluted 

1.15x  101 

Rabbitpox 

6.83x  102 

Rabbitpox  diluted 

6.84x  10° 

Cowpox 

2.59x  103 

Cowpox  diluted 

2.71x  101 

Bold  font  indicated  results  outside  range  of  acceptance  criteria 
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Supplemental  Table  9:  Ruggedness  testing  of  MGB  Master  Mix 


%CV 


Samples  Tested 

N 

Assay  #1 

Assay  #2 

Standard  5x  106 

4 

2.22 

1.54 

Standard  5x  105 

4 

0.60 

2.34 

Standard  5x  104 

4 

2.70 

1.32 

Standard  5x  103 

4 

4.50 

1.74 

Standard  5x  102 

4 

3.50 

1.71 

Standard  5x  101 

4 

23.39 

13.87 

PEC 

4 

47.47 

22.78 

PEC  aliquot  A 

4 

38.59 

24.60 

PEC  aliquot  B 

4 

39.86 

23.60 

PEC  aliquot  C 

4 

37.61 

24.79 

Bold  font  indicated  results  outside  range  of  acceptance  criteria. 
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Supplemental  Table  10:  Ruggedness  testing  of  extraction  kits 


Extraction  kit  lots: 


Lot#l 

Lot#2 

Sample 

GC/5ul 

GC/5ul 

PEC 

1.08x  104 

NA 

PEC 

1.15x  104 

NA 

Aliquot  A 

1.60x  104 

NA 

Aliquot  A 

1.63x  104 

NA 

Aliquot  B 

4.07x  104*(dropped) 

NA 

Aliquot  B 

4.21x  104*(dropped) 

NA 

Aliquot  C 

1.25x  104 

NA 

Aliquot  C 

1.20x  104 

NA 

PEC 

NA 

1.35x  104 

PEC 

NA 

1.33x  104 

Aliquot  D 

NA 

1.49x  104 

Aliquot  D 

NA 

1.52x  104 

Aliquot  E 

NA 

1.40x  104 

Aliquot  E 

NA 

1.40x  104 

Aliquot  F 

NA 

1.67x  104 

Aliquot  F 

NA 

1.64x  104 

Mean 

1.32x  104 

1.48x  104 

SD 

2.37xl03 

1.28xl03 

%cv 

17.98 

8.70 

Mean 

1.43x  104 

SD 

1.92xl03 

%cv 

13.41 

*  Dixon’s  Gap  Test  Where  N  is  less  than  9 
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Supplemental  Table  11:  Ruggedness  testing  using  two  LightCyclers  instruments 


Runs: 


VP42 

VP43 

VP44 

VP45 

Sample 

%CV 

%CV 

Standard  5x  106 

2.13 

1.06 

Standard  5x  105 

1.14 

2.20 

Standard  5x  104 

2.63 

1.04 

Standard  5x  103 

4.06 

2.29 

Standard  5x  102 

3.39 

2.47 

Standard  5x  101 

7.75 

25.56 

Positive  Control 

22.23 

5.21 

PEC  sample  A 

10.99 

4.22 

PEC  sample  B 

11.30 

7.47 

PEC  sample  C 

10.51 

3.44 

